Non-Stationary Stochastic Global Optimization Algorithms
نویسندگان
چکیده
Studying the theoretical properties of optimization algorithms such as genetic and evolutionary strategies allows us to determine when they are suitable for solving a particular type problem. Such study consists three main steps. The first step is considering Stochastic Global Optimization Algorithms (SGoals ), i.e., iterative algorithm that applies stochastic operations set candidate solutions. second define formal characterization process in terms measure theory some stationary Markov kernels (defined transition probabilities do not change over time). third characterize non-stationary SGoals, SGoals having with may time. In this paper, we develop study. First, generalize sufficient conditions convergence from processes. Second, introduce necessary arithmetic between measurable functions. Third, selection recombination schemes. Finally, formalize simulated annealing using systematic approach.
منابع مشابه
Non-Stationary Stochastic Optimization
We consider a non-stationary variant of a sequential stochastic optimization problem, in which the underlying cost functions may change along the horizon. We propose a measure, termed variation budget, that controls the extent of said change, and study how restrictions on this budget impact achievable performance. We identify sharp conditions under which it is possible to achieve long-run avera...
متن کاملOn Benchmarking Stochastic Global Optimization Algorithms
Amultitude of heuristic stochastic optimization algorithms have been described in literature to obtain good solutions of the box-constrained global optimization problem often with a limit on the number of used function evaluations. In the larger question of which algorithms behave well on which type of instances, our focus is here on the benchmarking of the behavior of algorithms by applying ex...
متن کاملStationary probability density of stochastic search processes in global optimization
A method for the construction of approximate analytical expressions for the stationary marginal densities of general stochastic search processes is proposed. By the marginal densities, regions of the search space that with high probability contain the global optima can be readily defined. The density estimation procedure involves a controlled number of linear operations, with a computational co...
متن کاملNon-Stochastic EM Algorithms in Optimization∗
We consider the problem of maximizing a non-negative function f : Z → R, where Z is an arbitrary set. We assume that there is z∗ ∈ Z with f(z∗) ≥ f(z), for all z ∈ Z. We assume that there is a non-negative function b : RN ×Z → R such that f(z) = ∫ b(x, z)dx. Having found zk, we maximize the function H(z, z) = ∫ b(x, z) log b(x, z)dx to get zk+1. It then follows that the sequence {f(zk)} is incr...
متن کاملNon-stationary Stochastic Optimization with Local Spatial and Temporal Changes
We consider a non-stationary sequential stochastic optimization problem, in which the underlying cost functions change over time under a variation budget constraint. We propose an Lp,q-variation functional to quantify the change, which captures local spatial and temporal variations of the sequence of functions. Under the Lp,q-variation functional constraint, we derive both upper and matching lo...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Algorithms
سال: 2022
ISSN: ['1999-4893']
DOI: https://doi.org/10.3390/a15100362